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FIELD OF THE INVENTION 

The present invention relates generally to systems and methods for the digital 
video encoding. More specifically the present invention relates to detecting scene 
changes to aid in dynamically creating Groups of Pictures. 

BACKGROUND OF THE INVENTION 



Throughout the specification and claims, we will be using the term MPEG 
(Motion Picture Expert Group). MPEG is a generic reference to a family of 
international standards, which define how to encode visual and audio information in a 
digital compressed format. MPEG is utilized in a wide variety of appUcations, 
1 5 including DVD (Digital Video Discs) and DVB (Digital Video Broadcasting). 

A key feature of MPEG is that it can compress a video signal into a fraction of 
its original size. MPEG achieves a high compression for video by storing only the 
changes firom one video frame to another, instead of each entire frame. This 
20 compression process is known as encoding and is done by an encoder. At the 
receiving end of an MPEG transmission, there exists a decoder, which decodes the 
transmission and restores it as best it can to the video signal originally encoded. 

There are two major MPEG standards: MPEG-1 and MPEG-2. The most 
25 common implementations of the MPEG-1 standard provide video quality slightly 
below the quality of conventional VCR (Video Cassette Recorder) videos. MPEG-2 
provides higher resolution, with full CD quality audio. This is sufficient for the major 
TV standards, including NTSC (National Standards Television Committee) and 
HDTV (High Definition Television). 

30 
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Of the series of MPEG standards that describe and define the syntax for video 
broadcasting, the standard of relevance to the present invention is ISO/IEC IS 138 18- 
2, ITU-T Recommendation H.262, titled "Generic coding of moving frames and 
associated audio information: Video," which is incorporated herein by reference and 
is hereinafter referred to as "the MPEG-2 standard". 

An MPEG video transmission is essentially a series of pictures taken at closely 
spaced time intervals. Often a picture may be quite similar to the one that precedes it 
or the one that follows it. For example, video of waves washing up on a beach would 
change Uttle from picture to picture. Except for the motion of the waves, the beach 
and sky would be largely the same. Once the scene changes, however, some or all 
similarity may be lost. The concept of compressing the data in each picture relies 
upon the fact that many images do not change significantly from picture to pictvire. 
Thus, considerable savings in data transmission can be made by transmitting only the 
differences between pictures, as opposed to the entire picture, hi the MPEG-2 
standard a picture is referred to as a "frame". This is terminology we will use from 
now on. 

Since the MPEG-2 standard specifies only bitstream syntax for compressed 
video, a number of methods have been proposed to improve the picture quality of 
compressed digital video produced by a video encoder. Among the most effective of 
these are the following: 

1) Pre-filtering 

2) Bitrate allocation based on the human visual system 

3) Rate-distortion optimal motion vector search and mode-decisions 

4) Two-step encoding with a look-ahead buffer for accurate rate-control, 
buffer management, and smoothing of CBR video quality. 

5) Dynamic GOP (Group of Picture) confrol 



This invention addresses an improved method and system relating to item 5). 



SUMMARY OF THE INVENTION 

The present invention is directed to an MPEG video encoder, the encoder 

having: 

a) means for analyzing statistics from a video stream; 

b) means connected to said means for analyzing statistics, for determining 
if a scene change has occurred; and 

c) means to create a modified video stream if a scene change has 
occurred. 

The present invention is also directed to a method for creating a modified 
video stream, the method analyzing the frames of an input video stream to determine 
if a scene cut, dissolve or fade has occurred. 

The present invention is further directed to a computer readable medium 
containing instructions for creating a modified video stream, the instructions 
analyzing the frames of an input video stream to determine if a scene cut, dissolve or 
fade has occurred. 

The present invention is further directed to a method for improving encoder 
performance, the method determining if a fade has occurred in a video stream, if a 
fade has occurred, modifying the video stream by selecting a frame with the lowest 
complexity in the fade as an I frame in the video stream. 

The present invention is further directed to a system for improving encoder 
performance, the system having detection means to determine if a fade has occurred 



in a video stream, if a fade has occurred, utilizing modification means to select a 
frame with the lowest complexity in the fade as an I frame in the video stream. 

The present invention is also directed to an MPEG video encoder, the encoder 

having: 

a) a statistical analysis module for analyzing statistics from a video 

stream; 

b) a scene change analysis module connected to said statistical analysis 
module for determining if a scene change has occurred; and 

c) a modification module to create a modified video stream if a scene 
change has occurred. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a better understanding of the present invention, and to show more clearly 
how it may be carried into effect, reference will now be made, by way of example, to 
the accompanying drawings which aid in imderstanding an embodiment of the present 
invention and in which: 

Figure 1 is a block diagram of a generic digital video system; 
Figure 2 is a schematic diagram of a group of frames in an MPEG video 
sequence; 

Figures 3a and 3b comprise a logical flowchart of a scene change detection 
algorithm. 

Figures 4a and 4b comprise a logical flowchart of a dynamic GOP algorithm; 
Figures 5a and 5b comprise a block diagram illustrating a dynamic GOP 
system coimected to an encoder; and 

Figure 6 is a schematic diagram of a dual pass encoding system. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



The transmission and reception of digital video requires complex hardware 
5 and software components. It is not the intent of this disclosure to address all such 
components but rather to address the specific areas within a digital video system in 
which the present invention may be utilized. 

By way of introduction we refer first to Figure 1, a generic digital video 
10 system, is shown generally as 10. Figure 1 is an overview of a generic system 10 in 
which the present invention may be utilized. System 10 comprises encoder 12, 
encoder transport system 14, transmitter 16, receiver 18, decoder transport system 20 
and decoder 22. Encoder 12 accepts as input, source video stream 24. Source video 
stream 24 may come firom a plurality of sources, but for the purpose of simplicity the 
15 reader may think of source video stream 24 as coming fi-om analog sources such as a 
television transmission. Encoder 12 receives source video stream 24 and through the 
utilization of any number of compression algorithms translates source video stream 24 
into an elementary video stream 26. The discussion of the structure of an elementary 
video stream and other details of MPEG-2 structure is beyond the scope of this 
20 disclosure. The structural details are defined in the MPEG-2 standard. 

Encoder transport system 14 receives video stream 26 and further restructures 
video stream 26 into transport packet stream 28. The details of the structure of 
transport packets are provided in the MPEG-2 standard. Stream 28 is then passed to a 

25 transmitter 16, which in turn forwards stream 28 to receiver 18 via a communications 
channel 30. Commimications channel 30 may take on a variety of forms such as, 
wireless or cable or any other form of transmitting data. Receiver 18 receives the data 
transmitted by communication channel 30 and in turn passes it in the form of a second 
transport packet stream 32. hi a perfect world, stream 28 and stream 32 will be 

30 identical. Decoder transport system 20 receives stream 32 and produces a second 
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elementary video stream 34. Once again, in a perfect world, stream 26 and stream 34 
would be identical. Decoder 22 accepts stream 34 and outputs reconstructed video 
stream 36. 



5 The present invention is utilized within encoder 12. To better understand the 

present invention, we will provide a brief and simplistic overview of how digital 
images are compressed. 

The MPEG-2 standards address many of the important issues relating to the 
10 exploitation of redundancies in video. Spatial, temporal and coding redundancies are 
all taken advantage of in the algorithms utilized to encode an MPEG-2 stream. 
Spatial redundancy occurs when picture elements (Pixels) in one frame are replicated 
in one or more succeeding frames. Temporal redundancy occurs when successive 
frames display images of the same scene. Coding redundancy is the encoding of 
1 5 spatial or temporal redundancies. 

There are two basic forms of compression for a frame in a video stream, 
interframe and intraframe. hiterframe compresses data based upon similarities 
between frames (thus "inter"), while intraframe compresses data based upon 
20 similarity within a region of a single frame (thus "intra"). A frame may be hitra (I), 
predictive (P) or Bi-directionally-predictive (B). 

An I frame is coded in isolation from other frames, thus it is coded using 
information only from itself I frames contain data to construct an entire frame. An I 
25 frame is often used to efficiently code frames corresponding to scene changes, i.e. 
frames that are different from preceding frames and cannot be easily predicted. 

A P frame contains only predictive information (i.e. not an entire frame) 
generated by looking at the difference between the present frame and the previous 
30 one. 
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B frames are created by examining the difference between the previous frame 
and the next frame in a sequence of frames. 

5 Both B frames, and P frames do not contain all the information necessary to 

view the frame until it is decoded within the context in which it appears. As they only 
contain predictive information, they do not make up a complete frame and so have the 
advantage of taking up much less data than an I frame. 

10 Frames between two successive I frames, including the leading I frame, are 

collectively called a group of pictures (GOP). This is the set of frames, which provide 
the context for the use of B and P frames. 

Figure 2 is a schematic diagram of a group of frames in an MPEG video 
15 sequence, shown generally as 40. Frames 40a to 40j are of different types, namely I, 
P and B. Frames 40a to 40j are shown in the order in which they would be displayed 
to a user. However, due to the requirement that P and B frames require information 
from other frames, the transmission order is actually: 40b, 40a, 40d, 40c, 40f, 40e, 
40h, 40g, 40j (which together form a GOP) and 40i. For example, frame 40i being a 
20 bi-directional frame cannot be transmitted until the differences in frames 40h and 40j 
have identified. 

To aid the reader in understanding the use of different frames, imagine we are 
looking at waves wash up on the beach from a stationary camera and the sky has only 

25 motionless clouds. The only thing that is moving is the waves, hi such a scene, 
encoder 12 (see Figure 1) would create an I frame, which is fransmitted to decoder 22. 
Decoder 22 passes the image on to video sfream 36 whereupon it is displayed to a 
user. Decoder 22 retains a copy of the information contained in that image. Next, 
encoder 12 generates a P- frame based on the motion of the waves. It generates a 

30 frame that has the identical background of the proceeding I frame. The waves have 
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moved a little. Encoder 12, using complex mathematics, compares the image it has 
predicted with the actual image. Encoder 12 then transmits data that represents this 
comparison, not the entire image. Decoder 22 utilizes the same complex 
mathematics. For decoder 22 to determine what the next frame should look like, it 
5 only needs to know the error between the prediction and the actual image to recreate 
the P frame. 

Should the scene change to a close up of a surfer on the beach, the image will 
have changed completely. This throws off the prediction process and requires an 
10 entirely new image, thus the process starts again, 

A fixed GOP structure is a commonly used method for encoding frames. A 
fixed GOP structure is one in which a fixed pattern of frames are used or in which a 
fixed number of frames are used to form a GOP. Encoding in this manner reduces 

15 complexity but does not allow for changing temporal statistics. Temporal statistics 
include frame mode such as I, B or P and GOP length. Since video sequences have 
variable scene durations, depending on the content, it is not always possible to use a 
fixed GOP structure to efficiently code a video sequence. This is because the position 
of I frames in the sequence depends on when scene changes occur. The present 

20 invention provides a mechanism to efficiently decide when to code a frame as an I 
frame and when to code a frame as P or B frame, namely mode decision. 

The basic building block of an MPEG frame is a macroblock. A macroblock 
consists of a 16x16 array of luminance (grayscale) pixels together with two 8x8 

25 blocks for chrominance (color) pixels. It is not the intent of this disclosure to discuss 
the technical details of the information in a macroblock as it is well known to those 
skilled in the art and well defined in the MPEG-2 standard. At the introductory level, 
one may consider a macroblock to be a digital equivalent of a portion of the analog 
RGB (red, green, blue) information transmitted by source video stream 24, before that 

30 signal is encoded to become video stream 26. 
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The MPEG-2 standard allows for macroblocks in a P frame to be intra coded if 
they can not be predicted efficiently. This means that even if all the frame types are 
5 set to be P, there may be many macroblocks in each frame that are intra coded. This 
macroblock based mode decision may be used to account for scene changes. 
However coding a P frame is more computationally expensive than coding an I frame. 
This is because coding P frames uses motion estimation and compensation and also 
the additional decision for each macroblock in the frame. Hence making the decision 
10 at the frame level to code a frame as an I frame is more efficient in terms of 
computation. 

Video can be ftirther compressed by taking advantage of scenes where the 
information used to determine if a scene change has occurred allows for larger 
15 interreference frame distances (i.e. larger GOP and dynamic GOP). The additional 
compression over the fixed picture arrangement style comes from the reduction in the 
number of reference frames (i.e. B and P frames) which require more bits in order to 
provide high quality prediction. 

20 Dynamic GOP coding requires sensitivity to different types of scene changes 

such as scene cut, dissolves and fades. Lituitively, high motion requires more 
frequent placement of reference P frames to uphold quaUty. Low motion, on the other 
hand, allows larger distances between P frames since the correlation remains high 
over a larger span of frames. The frames in between P frames are coded as B frames. 

25 Scene cuts or scene changes require prediction dependencies to be reset to I frames as 
the next frame cannot be predicted. 

The present invention utilizes dynamic GOP generation based on video 
content to improve the video quality. 

30 
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Traditional use of dynamic GOP generation makes use of two steps, namely: 

a) scene change detection, to detect changes such as scene cut, dissolve or fade; 
and 

5 b) mode decision strategy such as GOP size and when I, B or P frames should be 
used. 

We will now discuss each of these in turn followed by a description of the 
implementation of the present invention. 

10 

1.0 Scene Change Detection 

There is a large amount of Hterature regarding scene change detection. It is 
not our intent to explore the prior art in great detail, however we will provide some 
15 introductory material. In doing so, we refer now to Figures 3a and 3b where a logical 
flowchart of a scene change detection algorithm is shown generally as 60. Algorithm 
60 utilizes input data 62 at analysis step 64 to determine if a scene change has 
occurred. Analysis step 64 may make use of a number of comparisons utilizing input 
data 62, some of the most common being: 

20 

a) pixel comparison; 

b) histogram comparison; and 

c) DC images comparison. 

25 Pixel comparison evaluates the differences in intensity or color values of 

corresponding pixels in two successive frames. The simplest method is to calculate 
the absolute sum of the pixel differences and compare it against a threshold. A scene 
cut is detected if the difference is above the threshold. 
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Histogram comparison compares the gray level histograms of the two frames. 
Two frames with not much difference in their background and some amount of object 
motion have almost the same histograms. The histogram for a frame is obtained by 
summing the number of pixels belonging to each gray level in the frame. If difference 
between each frame is greater than the given threshold then a scene cut is detected. A 
similar scheme is available for color. 

DC images comparison utilizes DC images in the same manner as Pixel or 
Histogram comparison to detect scene changes. DC images are spatially reduced 
versions of the original images. 

After the input data has been analyzed at step 64, a test is made at step 66 to 
determine if a scene cut has occurred. A scene cut is a sudden change in a scene. If a 
scene cut has been made, processing moves to step 72 (Figure 3b). Otherwise 
processing moves to step 68 where a test is made to determine if a dissolve or fade 
has occurred. A dissolve occurs when one scene gradually disappears while another 
appears. A fade is a scene gradually disappearing or appearing. If a dissolve or fade 
is detected then processing moves to step 72 (Figure 3b). Otherwise processing 
moves to step 70 where a test is made to determine if a wipe scene change has 
occurred. A wipe is where one scene gradually enters the view while another 
gradually leaves. If a wipe is detected processing moves to step 72 (Figure 3b). 
Otherwise processing moves to step 74. 

Step 72 passes control to step 76 where a test is made to determine if a 
flashlight has occurred. A flashhght is a term used in the art to describe a scene 
where an individual is in front of a number of cameras, with numerous flash 
photographs being taken. If a flashlight has occurred then processing moves to step 
80 which indicates no scene change has been detected. If a flashlight has not occurred 
than processing moves to step 78 which indicates a scene change has been made. 
Process 60 then moves from step 78 to the end at 82. Returning now to step 80 this is 
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point where the positive test from step 76 and the transition step 74 meet, at this step 
no scene change has been detected. From step 80 processing ends at step 82. 

2.0 Mode Decision 

The MPEG-2 standard allows for different kinds of coding modes for frames. 
By this we mean the types of frames coded, their order and the size of a GOP. Mode 
decisions involve choosing between different courses of action or modes to improve 
the performance of the video coding. Examples of mode decisions are: setting GOP 
size, and determining when I, P or B frames should be inserted. There are many 
mode decisions in the encoding process and these may be at different coding level. 
For instance some mode decisions are made frame by frame while others are made on 
a block by block basis. Each of these different mode decisions has a cost associated 
with it. This cost may be defined in terms of the bits, the time needed, the quaUty, or 
a combination of some of these. So the mode decision involves choosing the mode 
that has a smaller cost associated with it. 

fri principle, to make the optimal decision one can try all the modes and 
choose the mode that has the lowest cost. However, computing the actual costs before 
making a decision is very computationally intensive as this involves trying every 
mode to determine the cost. 

It is also well known that implementations of the MPEG-2 standard perform 
very poorly during fade-to-black (or gray) and fade-from-black (or gray). This is 
because motion compensation performs very poorly during this frequently used video 
effect. Unfortunately, television programs such as music video channels use this 
video effect exfremely often (as often as once every couple of GOP). This results in 
very poor quahty for Continuous Broadcast Rate (CBR) video at low-bitrates. 

3.0 Intra-frame Complexity based dynamic GOP 
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The present invention makes use of a new dynamic GOP method and system 
that identifies the preferred locations for I frames as not only at the start of new 
scenes, but also on the lowest complexity frames (requiring the fewest bits to encode 
as an I frame). This is done when an I frame must be placed to maintain a reasonably 
low dynamic access time. For example, for sequences with frequent long fades, there 
is an attempt made to place I frames that are required for a random access on the 
'black' frames in the middle of the fade, which require very few bits to code. 
Additional I frames are placed between these 'preferred locations' as required to 
satisfy the minimum random access of the stream. Rapid random access to I frames is 
required in the situation where decoder 22 gets out of synch with the video stream 
being decoded and must access an I frame to reset the stream. 

Referring now to Figures 4a and 4b, a logical flowchart of a dynamic GOP 
algorithm of the present invention is shown generally as 100. 

Beginning at step 102 frame statistical data is obtained regarding the current 
frame, this includes information such as the number of bits in the encoded frame and 
quantisation values for each macroblock in the frame as well as various data required 
to determine if a scene change has occurred. 

At step 104 the global complexity of the frame is calculated. The present 
invention utihzes the complexity definition of the MPEG Test Model 5 (TM5) model 
directly, namely the global complexity of each frame is defined as: 

Where is the number of bits generated by encoding the frame and & is the average 
quantisation parameter computed by averaging the actual quantisation values used 
during the encoding of the all the macroblocks, including the skipped macroblocks in 
the frame. The frame x may be type of I, P or B. 
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Scene change analysis is also performed at step 104. As mentioned above in 
section 1.0, scene changes may be detected in a variety of ways. 

Moving to step 106 a test is made to determine if a scene change has occurred. 
If not, processing moves to step 108 otherwise to step 110. Since no scene change 
was made, step 108 moves to step 124 (Figure 4b) where the current frame is added as 
a new frame in the GOP and the process ends at step 126. 

Step 110 moves to step 112 where a test is made to determine if the scene 
change is a scene cut. If a scene cut is detected, the current frame is the first frame of 
a new scene. This situation is handled by coding the current frame as an I frame and 
the previous frame as a P-frame to reset the prediction dependencies. Coding the 
previous frame as a B-picture would allow the old scene to reference the new scene, 
which should be forbidden since the content is completely different. Process 100 then 
completes at step 126. If there has been no scene cut detected, processing moves to 
step 116. 

At step 116 a test is made to determine if a dissolve has been detected. If a 
dissolve is detected, processing moves to step 118 and the current frame is encoded as 
a B frame instead of a P or I frame. This is done because a dissolve frame is 
generated by the previous frame and next frame. In the case of using a dual pass 
encoder (see Figure 6) this may result in a change of the previous GOP structure. 
Process 100 then completes at step 126. If there has been no dissolve detected, 
processing moves to step 120. 

At step 120 a test is made to determine if a fade has been detected, a frame 
(within the fades) with the lowest complexity is chosen as an I frame. 
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As one skilled in the art can appreciate process 100 is repeated by encoder 12 
for each frame in source video stream 24. 

Put simply, the present invention: 

a) places lowest complexity I frames into the GOP during fades; and 

b) treats different types of scene changes differently. 

This is a different method from the traditional "scene cut" preferred I frame 
location, which is immediately after the scene change. The intent of the traditional 
method is to achieve good prediction for the new scene. The fraditional method has 
been widely used and is frequently reported in literature relating to scene changes. 

During fades, I frames are ineffective for use in predicting, so they would 
normally be avoided if not for the practical requirement of minimum access time. 

The same sfrategy can be used whenever motion compensation breaks down, 
for example, I frames could be placed as far away as possible from fast zooms and 
other video effects. However, extremely low-complexity frames (such as black 
frames with fades) which are preferred locations on which to place the required I 
frames, are not always consistently available during video effects, so the effectiveness 
of this strategy is reduced. 

Referring now Figure 5a, a block diagram illustrating a dynamic GOP system 
connected to an encoder is shown generally as 140. External data 142 comprises 
statistical information on the video stream being encoded and is provided as input to 
dynamic GOP decision module 144. Module 144 makes use of the same logic 
described with regard to Figures 4a and 4b to determine when a GOP should be 
modified based upon detected scene changes. Source video stream 24 is the source 
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video stream 24 of Figure 1. Thus the components of Figure 5 a sit in front of encoder 
12 to modify source video stream 24 as required to implement the present invention. 

Referring now to Figure 5b, encoder 12 accepts reformatted video stream 146 
from module 140. Reformatted video stream 146 is input to module 142, which 
subtracts motion compensated prediction from a frame to form a "prediction error" 
frame. The prediction error frame is passed to Discrete Cosine Transform module 
144, which transforms the frame and passes it to Quantiser module 146. Quantiser 
module 146 quantises the coefficients produced by module 144 and creates a new 
frame. The new frame may have to be recalculated based upon prediction error, thus 
the reason for the loop comprising blocks 150, 152, 154 and 156. 

Once the frame has been successfully encoded it is passed to Variable Length 
Coder module 148. Module 148 then transmits elementary video stream 26 to 
encoder transport system 14 (Figure 1). 

With regard to the above description of Figure 5b, it is not the intent of the 
inventors to describe in detail the ftinctionality of the modules shown. The 
fimctionaUty expected of such modules is defined in the MPEG-2 standard and 
numerous variations within both the modules and the structure of encoder 12 are well 
known to those skilled in the art. Figure 5b is simply meant to illustrate an instance 
where the present invention may be utiUzed with a specific encoder design. 

Referring now to Figure 6 a schematic diagram of a dual pass encoding system 
utilizing the present invention is shown generally as 170. Source video stream 24 is 
input to first pass encoder 172 under conventional CBR control. First pass encoder 
172 outputs a conventional CBR sfream 174 for use by components outside the 
system such as an MPEG-2 multiplexer. First pass encoder 172 also outputs certain 
statistics of the input video data, such as frame mode, GOP length, bits used per 
frame, bit rate, and quantisation information, hi some situations first pass encoder 
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may provide direct information on a scene change. These statistics are next processed 
by processing module 176. The processing done by module 176 is done off-line, as it 
does not require the video data, rather only the statistics. The task of processing 
module 176 is to compute the parameter settings for the second pass encoder 178. 
5 Using the parameters provided by module 176 and source video stream 24, second 
pass encoder 178 is run to produce output video stream 26. 

By way of example, the present invention may be implemented using two 
IBM MPEG-2 S series encoder chips such as S420 or S422. In this example one 

10 encoder would act as the first pass encoder 172 and the second as the second pass 
encoder 178. Utilizing such an encoding system, first pass encoder 172 yields 
numerous statistics such as: scene change indicator, fi-ame activity (i.e. variance from 
the original fi-ame as described in TM5), actual bits for the current frame, the average 
quantisation parameters for the ciirrent frame, and the video quality indicator (which 

15 refers to the error between the reconstructed frame and the original frame). Based 
upon this information it is possible to calculate frame complexity using the formula 
discussed earlier. Knowing the value of frame activity and given a scene change 
indicator, the present invention could distinguish a fade from several scene cuts in a 
row. When several scene change indicators occur in a sequence, if the frame 

20 activities are close to each other, than a fade has occurred otherwise there are several 
scene cuts. Also by knowing the frame complexity, activity and quality indicator it is 
possible to locate the black frame inside a fade. This frame typically has the lowest 
frame complexity, lowest frame activity and highest video quality indicator. 

25 When module 176 locates a fade in the video sequence, it can generate new 

GOP parameters for the second pass encoder 178, by treating the lowest complexity 
frame as an I frame. 

The present invention is able to reduce the impact of the large number of bits 
30 required for I frames when encoding video at a very low bit rate, especially for 
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sequences with frequent fades, which are often very difficult to encode at high 
quality, given a low bit rate. 

Although excellent "fade-to/from black" detection is possible by observing 
5 mean frame luminance and variance , many commercially encoded video streams do 
not currently use effective fade detectors. As a result, they identify fades as multiple 
scene changes and place far too many I frames during fades. This results in poor 
quality at low bit rates. A first step towards improved quality is to properly identify a 
fade and suppress excess I frames. This substantially improves quality at low bit 
10 rates. 

The present invention goes beyond suppressing I frames to determine an 
optimal placement of I frames during fades using frame complexity. 

15 Although the invention has been described with reference to certain specific 

embodiments, various modifications thereof will be apparent to those skilled in the art 
without departing from the spirit and scope of the invention as outlined in the claims 
appended hereto. 
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